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This study tested the hypothesis that teacher 
involvement in curriculum evaluation facilitates curriculum 
implementation. Curriculum implementation is defined as a function of 
the elements (s) of a particular referent curriculum. A random sample 
of 24 teachers^ eight taken from each of three grade levels, served 
as subjects (S*s) for experimental and control groups. s*s evaluated a 
social studies curriculum through a series of meetings with the 
director of Instructi<»ial Services. Observations were made over a 
10-week posttest period, and teachers were rated (using a modified 
version of the OScAR 4V) on teacher-pupil verbalizing relevant to the 
curriculum. Findings indicate th^t curriculum implementation was 
facilitated differentially by degree of involvement in curriculum 
engineering. (JB) 
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Considerable time, effort, and financial resources have been allocated and 
spent In the decade Just past In efforts to develop new currlculums. This Is 
reflected In the efforts of both the so-called national curriculum projects and 
many groups in local school districts. However, the expenditures Invested have 
not resulted In systematically implemented currlculums and the changed emphases 
In objectives, subject-matter, and instructional strategies presumably Intended* 

Alexander (1962) stated more than a decade ago that more is known about the 
extent to which curriculum pr<H>osdls are made than the extent of their Implementa- 
tion. Indeed, one recent study (Schwartz, I97I) Is typical of the emphasis ~ In 
research as well as in practice on origination and dissemination of new curric* 
ulums rather than upon their implementation and Integration Into instructional 
systems. 

Some of the variables related to curriculum Implementation have been <fl^ 
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Identified and categorized (Gress, 1972, pp. 28-33)* Those variables Include: 
(1) characteristics of the curriculum Itself, (2) characteristics of the teacher 
as a unit of Implementation, and (3) characteristics of other Instructional In- 
puts (Ue.ythe resources and constraints of a given Instructional situation). 
And the teacher's relationship to a curriculum system, as a variable associated 
with curriculum implementation, has provided the basis for some research. How- 
ever, little experimental evidence exists of the effects upon curriculum Imple- 
mentation of particular teacher relationships to curriculum systems as defined by 
given curriculum engineering tasks. 

The Problem 

Teacher Involvement In such engineering tasks as curriculum planning and 
eveluatlofli conttltute tmportant determinants of curriculum implementation and 
consequent instructional change (Anderson, 1965f PP» 56-61; Beauchamp, I96'*, pp* 
355-356; Saylor and Alexander, 1966, pp. ^05-^37). Perhaps the earliest report 
to that effect was among some conclusions offered by Saylor In 19^1 (pp. 212-221) 
In his study of a curriculum system, Saylor concluded that there was general 
curriculum adoption and Implementation where teachers participated In curriculum 
planning and In the construction of Instructional materials. 

Heusner (1964) and Krey (1969) both concluded that curriculum Implementnio 
is dependent. In part, upon the teacher's recognition of the need for ch^inge ^nd 
consequent Implementation. In addition, McQuIgg (1963) and Edwards (1969) have 
supplied research evidence to support their common assertion that the teacher's 
understanding of a curriculum. Its relevance to an Instruct ton>»l $ltu;^tIon, and 
his role In the Implementation process is a determinant of change. L^ngenbach 
(1970) concluded that teachers who had participated In curriculum planning had 
more positive attitudes toward curriculum use than teachers who had never p^r- 
ticipated. Johansen (1965) offered data to support his thesis that teacher par- 
ticipation in curriculUTii planning increased the probability of curriculum 



implementation If the t^'^cher perceived that he was Influential In curriculum 
decision-making. Black (1968) found that teacher participation In curriculum 
evaluation was significantly related to differences in curriculum implement ^tion« 
Teague also asserted that .teachers will spend more time and effort In progr^^ms 
they helped plan, participated In, or had an opportunity to evaluate" (Teague, 
1963, p. 

This study was undertaken to gather experimental evidence to support ^ thesis 
relating teacher Involvement In decis ion*-maklng with curriculum Implementation, 
The study posed the hypothesis: Teacher involvement In curriculum cv^lu^tlon fa- 
cilitates curriculum Implementation* 

Research Design 

For this study, a curriculum was conceptualized, and curriculum Implementa- 
tion was operational i zed, within the systems of schooling framework provided by 
Beauchamp (1968, pp. 110-lMf), the definition of curriculum implementation being 
a function of the element(s) of a portlcutar referent curriculum* The design 
features of a curriculum might include an outline cf subject-matter, a statement 
of goals and/or specific objectives, 'i rationale for the curriculum itself, and 
an evaluation schema (Beauchamp, 1968, pp. 83'85)« In addition, many curriculums 
contain descriptions of Instructional activities, bibliographies of Instruct lon^^t 
materials, and descriptions of classroom Instructional strategies (Beauchamp, 1963). 

JbS New Trier Townshi p K-8 Social S tudie s Curriculum , used as a vehicle for 
this study. Included many of the elements identified here. Since curriculum im- 
plementation could be operational ized In terms of the extent to which emplrlc-^l 
data might be gathered In an Instructional situation based on the element(s) of 
the curriculum's design, classroom verbal interaction was defined in this study 
In terms of a description of the instructional strategies cont'sined in The New 
Trier Townshi p K*8 Social Studies Curriculum (Chapter 3). Figure I displays the 
relationship between characteristics of instructional discourse described in this 



social studies curriculum and twelve scales of te'tcher-pupt I cl^^^ssroom verbal be- 
.havior derived by combining selected categories of the OScAR (Simon and Boyer, 
1970» pp« l3:l'-^)« (interpreting curriculum implement -^t ion as a function of 
verbal beh'^vior In the classroom has also been done by Hawthorne (1968; 1971) 
and H3rty (1972)). 



Characteristics of Instructional 
Discourse Described In the 
Social Studies Curriculum 

The basic mode of discourse is 
quest loning. 



The teacher rarely ••tells" his 
students what they need to know. 



The teacher •s questioning is not 
directed at a single student re- 
sponse. 

The teacher encourages active 
student participation in Instruc- 
tion. 



The teacher shows empathy In 
his reinforcement of students • 
ideas » statements » and questions. 



Soles of Verbal Behavior Derived 
from the OScAR C'^tegorles 



-f Te'fcher Substantive Interchanges (TS 

- Teacher Statements (TS) 

4- Teacher Problem-Structuring (PRB) 

- Teacher Lecturing (LCT) 

^ Divergent Questioning (DVG) 

- Convergent Questioning (CVG) 
4- Pupil Statements (PS) 

-I- Pupil- Initiated Behavior (PUP) 

- Teacher- InltHt^d Behavior (TCH) 
Teachers • Responses (WEX) 
Teacher Considering Behavior (CSD) 
Teacher Rebuking Behavior (RBK) 



Figure 1 

Characteristics of Social Studies Instruction 
and Related Verbal Behavior Scales 



For the study, a stratified random sample of twenty-four teacher-class com- 
binations was selected from teacher-^class units In Elementary School District 39 
(Cook County, Illinois)* eight teacher-class units at each of three grade levels 
assigned randomly to experimental and control groups. The dlstrlct^s Director of 
Instructional Services, the administrator responsible for the dlstrlct^s curriculum 



system, also participated iii the study. 

The treatment for teachers in the experimental group consisted of p'irticlp'j- 
tlon in an evalu'ition of the social studies curriculum used. The evlu^tion w^s 
accomplished through a series of formil and Inform'^l meetings involving the dis- 
trict's Director of Instructional Services with the teachers. These experiences 
were structured according to selected principles of organization theory (Bennis, 
1966; Benne, }SkS, pp. 20i*-207; Jensen, I969, pp. 1C3 208). The experinr^ntal 
treatment was initiated in December, 1970, and culmin=jted in April, 1971, with 
the teachers' formulation of the eviluttion. The treatment for teachers in the 
control group consisted of no participation in the evaluation tasl<s. 

A modified version of the OScAR 4v (Medley and Mitzel, 1963. PP. 278 286; 
Medley and Hill, 1968) was employed to assess the dimensions of teacher-pupil 
classroom verbal behavior relevant to the curriculum. Each teacher who partici- 
pated in the study was observed during social studies instruction on four different 
occasions. The observations were made during a period of ten weel<s after the ex 
perimental treatment had been initiated. Each observation lasted for one-half 
hour which included time for observer orientation to the Instruct ion=*l setting. 

For ertch teacher, scores were computed for each of the twelve OScAR soles 
described. The reliability for each of the tw^ e scnles w^s estimated by the 
three-way analysis of varls»nce technique described by Medley »nd Mitzel (1958, 
pp. 23- 25). Teachers, observations, and OScAR categories were considered fixed 
effects. Table 1 summarizes the ANOVA findings and the reliability indices derived. 

To test for differences In teachers" total scores on the twelve scales of 
verbal behavior, use of a multivariate amlysls of variance (MANOVA) was planned 
(Bock and Haggard, I968, pp. 100-1^12; Rulon and Brooks, I968, pp. 72-76).^ Tests 
of the assumptions of the MANOVA model were made. Mul tinormal Ity of population 
variables (Morrison, 1967, pp. 125-168) was tested Indirectly by probit analyses 



The author wishes to acknowledge the assistance of John McConnell, pres 
ently a Northwestern University doctoral candidate. In the analysis of data. 
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TABLE I 

Reliability Co-efficients Derived By Analysis Of 
Variance for Twelve Scales of Verbal Behavior 



Scale 


Hoyt R 


Scale 


Hoyt R 


Scale 


Hoyt R 


TCH^''' 


0.597 


a,b,c 

CVG 


0.703 


PS^ 


0.716 




O.U75 




0.739 


^£^a,b,c 


0.705 


lct" 


0.756 


TS^'** 


0.527 


CSD * 


0.'!60 


PRB^''' 


0.7^7 


TSl"''''*^ 


0.772 


a,b,c 

RBK 


0.823 



. p < .05 Among Teachers 
pC.05 Among Categories 
p< .65 Among Observations 



(Goulden, 1952, pp. 39'»-^I7) of the Individual distributions of scores. The dis 
tributtons of scores on the PRB, PS, CSD, and RBK scales were found to depart sig 
nif icantly from normality. Homogeneity of dispersion (Hope, 1968, pp. 29-301 
Bock, 1966, pp. 810-8^0) was tested Indirectly by applying the F^^^ criterion 
(Winer, 1962, pp. 92-95) to the withln-groups variances for e^ch of the twelve 
scales. Means and standard deviations of teachers* scores on the twelve sc^^les 
are displayed by treatment-group and grade-level in T^ble 2. Withln-groups vnr 
iances^of teachers' scores produced by the PRB, PS and WEX scales were found to 
be nonhomogeneous. On the basis of these findings and by examining the inter- 
correlations of scores on the twelve scales for the experimental and control 
groups, five of the scales of verbal behavior were excluded from further analysis. 
Data for the TCH, PUP, TS, TSI, CVG, DVG and LCT scales were used In the main 
analysis. To characterize significant multivariate differences, use of multiple 
linear discriminant functions was planned (Rao, 1952, pp. 237 2'*8; Bock and Haggard, 
1968, p. 117; Morrison and Art, 1967). 



Additional statistics derived from various analyses of data for each of the 
twelve verbal behavior scales Is available from the author upon request. 
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TABLE 2 

Means And Standard Deviations Of Teachers' Scores 
On Twelve Scales of Teacher-Pupi I Verbal Behavior 
By Treatment Group And Grade Level 



SCALE 



Treatment Grade 



Group 


Level 


N 




TECH 


PUP 


LCT 


PRB 


TS 


TSI 


E 


2 


k 


M 


Sh,7S 


25.75 


24.50 


3.25 


56.25 


46.00 








SD 


17.17 


7.93 


8.34 


3.20 


15.06 


11.19 


E 


5 


k 


H 


78.00 


29.25 


14.00 


5.00 


^3.25 


34.25 








SD 


5.71 


10.43 


6.48 


5.09 


14.08 


10.14 


E 


8 


k 


M 


85.50 


21.25 


31.00 


5.00 


65.25 


19.50 








SD 


5.91 


11.23 


13.34 


2.58 


5.31 


9.32 


C 


2 


k 


M 


93.50 


24.00 


11.25 


3.75 


46.50 


28.50 








SD 


20.02 


7.30 


9.21 


2.36 


14.61 


9.95 


C 


5 


k 


M 


83.75 


38.00 


20.75 


3.00 


56.25 


27.25 








SD 


13.15 


24.56 


18.71 


3.55 


17.25 


4.34 


c 


8 


k 


M 


^5.25 


55.25 


15.75 


1.75 


35.00 


9.75 








SD 


18.08 


17.23 


10.07 


.50 


9.05 


14.66 










CVG 


DVG 


PS 


CSD 


RBK 


WEX 


E 


2 


H 


M 


15.75 


12.75 


7.50 


7.00 


8.25 


8.75 








SD 


8.26 


7.76 


8.58 


4.08 


5.43 


18.00 


E 


S 


k 


M 


18.00 


14.00 


11.00 


4.50 


12.75 


-6.25 








SD 


k,2k 


10.13 


8.90 


3.90 


14.88 


4.27 


E 


8 


k 


M 


13.00 


5.75 


7.50 


4.75 


4.50 


-9.25 








SD 


7.61 


2.75 


7.85 


3.30 


4.72 


14.31 


C 


2 


k 


M 


25.75 


19.25 


5.00 


8.50 


8.25 


15.00 








SD 


9.21 


5.56 


2.70 


4.12 


5.73 


23.13 


C 


S 


k 


M 


19.25 


6.75 


14.50 


4.50 


9.00 


-6.00 








SD 


7.^1 


5.37 


23.74 


1.73 


3.91 


34.59 


c 


8 


k 


M 


5.50 


4.25 


40.50 


4.50 


2.75 


-4.25 








SD 


7.55 


7.22 


26.76 


1.73 


2.21 


11.44 
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Results 

Based on tests of the assumptions of the HANOVA model » data pertaining to 
seven scales of teacher^pupi I classroom verbal behavior were subjected to a 2 x 3 
multivariate analysts of variance. The results of the analysis are siflivnarized 
in Table 3. 

TABLE 3 

Multivariate Analysis of Variance Of Teachers' Scores 
On Seven Scales of Teacher^Pupil Verbal Behavior 



Tests of Roots 
Source Using WiH<s' Lambda 



Treatment Group 

Roots 1-1 7.0 12.0 0.805 .599 .5^5 

Grade Level 

Roots 1 - 2 lU.O 24,0 2.321 .03^ .06^1 

Roots 2-2 6.0 12.5 .83^ .565 .535 

Interaction 

Roots 1 - 1 lU.O 24.0 2.715 .015 .831 

Roots 2-2 6.0 12.5 2.230 .109 .719 



The result of the F-test of treatment group differences not significant (p>.05)» 
but the results of the F*-tests of differences among grade levels and differences 
attributable to treatment group*-grade level interaction effects were significant 
(p'^.05). It was concluded that there were no differences between teachers attri- 
buable only to treatment effects, but that there were grade level and interaction 
differences. 

Tlie data were subjected to post hoc discriminant analyses for grade leve?^ 
and interaction effects. Table k summarizes the results of the analysis for 
grade level effects. Since the stepwise procedure utilized selected only one 
variable, TSI, for the resultant linear function, no further discriminant analysis 
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-^For the three-group discriminant analysis, the error term Is greater than 
that used In the multivariate analysis since treatment group effects were 
not separately partitioned. 



TABLE k 

Multiple Linear Discriminant Analysts 
For Grade Level Effects 

^^^^^^^^sfanSarffTze^^^^^^^^^^^^^™" ' 
Univariate tests DIscr iminanant 

Function Correlations Contribution to 



Variable 


MS F(df=2.l8) 


fi 


Coefficients 


w/Compos i te 


Rao's V 


TCH 


1163.167 5.52'* 


.013 


6Mk 


MS 


TCfCVC 


PUP 


369.125 1.769 


.199 


.210 


',22k 




LCT 


88.667 


.537 


-1.028 


-.150 




TS 


5.792 .033 


.967 


-4.790 


.016 




TSI 


1085.5^^2 10.050 


.001 


-.507 


.611 


16.03 


CVG 


299.5'*2 5.269 


.016 


-2.115 






OVG 


2lf2.0it2 5.139 


.017 


-1.601 


M2 





i..irk Insignificant 

was possible. Further analysis using Scheffe's comparisons (Ferguson, 1966, 
pp. 295*-297) revealed that differences among teachers in teacher-- initiated sub- 
stantive interchanges (TSI) could be explained in terms of differences between 
second and fifth versus eighth grade teachers, and it was concluded after further 
examination of the data that eighth grade teachers tended to use questioning as 
a basic mode of instructional discourse to a significantly lesser extent than did 
the other teachers. 

Table 5 summarizes the results of the discriminant analysis for interaction 
effects. Two discriminant functions were generated. Each of those functions 
contained co-^eff icients for scores in the TS and TSI scales. Figure 2 displays 
the discrimination of the group centrolds generated by the functions. The first 
function discriminated between eighth grade and other teachers. The second 
discriminated further between treatment groups. Re-exomlnnion of the d^ta 
reveoled that tenchers in the experimental group at iich grnde level scored con- 
sistently higher on the TSI scale th^in did their counterparts In the control 
^ group. 
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TABLE 5 

Multiple Linear Discriminant Analysts 
For Interaction Effects 

Univariate F-tests Standardized Correlations 

Discriminant Function w/Composlte Contribution 
Variable MS F(df«2 .18) p 1 Coefficients 2 J 2 to Rao's V 



TCH 


1508.667 


7.165 


.005 


11.706 


5.099 


.469 


-.535 




PUP 


675.292 


3.237 


.063 


-.243 


.852 


-.365 


.244 


-kick 


LCT 


296.000 


2.149 


.146 


-.972 


.088 


-.039 


-.469 




TS 


936.125 


5.366 


.015 


-9.766 


-5.095 


.150 


0.715 


UM 


TSI 


450.125 


4.167 


.033 


-5.715 


1.805 


.444 


.151 


ZBM 


CVG 


153.125 


2.694 


.095 


-.993 


-4.146 


.359 


-.105 


TTfCfC 


OVG 


35.375 


2.025 


.161 


-1.128 


-2.545 


.232 


.313 





insignificant 



Since Questioning as a basic instructional mode of discourse was implicit 
In the curriculum design, it was concluded that second and fifth grade teachers 
implemented the curriculum to a greater extent than did eighth grade teachers. 
But, more importantly here, It was also concluded that the experimental group 
tended to utilize that mode of discourse to a greater extent than did the control 
group. And, since fifth grade teachers also utilized an antithetical mode of 
discourse (TS) to a significantly lesser extent. It was concluded that the 
experimental treatment was differentially effective among teachers at different 
grade levels. 
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E - Experimental Treatment Group 
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5 =* 5th Grade Teachers 
8 » 8th Grade Teachers 

Figure 2 

Two- Dimensional Discrimination of Six*Group 
Centroids for Multivariate Verbal Behavior 
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Discussion 

It was concluded that curriculum implementation, as defined, was facillt^iated 
to some extent, if differentially, for teachers Involved in the curriculum engineer- 
ing task described. However, the study suggests that generalizing from the limited 
results of the study to the effects upon curriculum Implementation potentially attri- 
butable to on-going teacher involvement In curriculum engineering decision-making is 
necessarily constrained by: 

1. The nature and extent of the curriculum . jering task(s); 

2. The type and number of teachers involved in the decision-making process: 

3. The nature of the curriculum and its design elemeni:(s)« 

First, teachers, in this study were Involved In a specific decision-making 
task — evaluating a pilot curriculum -- for the purpose of making a decision about 
Its adoption and/or revision. In defining participation, other decision-making 
tasks might also be operational Ized, e*g.. Initial design of a curriculum, on-going 
evaluation of an already adopted curriculum, negotiating for the Implementation of 
specific Instructional objectives. Perhaps, as Is suggested by the results of the 
study, different tasks are differentially effective with different teachers. Perhapt 
Involvement In a particular combination of tasks optimizes Implementation. Further, 
the question of extent, both over time and In degree, of Involvement Is a factor 
to be considered* In this study. Involvement In decision-making was uniformly and 
arbitrarily defined and the period of Involvement limited to several months, Perhap. 
other types of Involvement In decision-making would have yielded different results. 
Perhaps, given the nature of the curriculum, the length of time during which teachers 
were Involved was not adequate for demonstrable change or perhaps the lapse of time 
between Involvement and potentially demonstrable change precluded the gathering of 
stronger experimental evidence In this study. 

Secondly, In this study, twenty-four teachers from a school district In an 
upper-middle class socio-economic community were Involved* Perhaps variables relate 
to unique characteristics of that group, or to their school district and Its other 
Tv^lcles, or to the population of students rer > 3sented contributed to the particular 
effects of Involvement In decls ton«maklng Identified. Or, given a larger sample. 
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more demonstrable effects might have been shown* Or, perhaps involving all teachers 
in a school district in curriculum decision»making» if indeed this is a viable 
principle of curriculum engineering, may generate more conclusive results. Or» as 
is suggested perhaps grade level effects are an important variable over all population 

' --3^ /, the nature of the curriculum itself seems important here, Faray (1970) 
has reported that the nature of the subject-matter w^s an important variable in the 
implementation of a curriculum, and it seems relevant that the social studies curri* 
culum used as a vehicle for this study dealt with many controversial issues (as it 
may well should have) including race relations, environmental concerns, and the like* 
And perhaps the particular combination of design features of a curriculum facilitate 
per se its Implementat ion# Perhpas, while teachers may not have utilized recommended 
instructional strategies, they did cover the subject-matter intended and to that 
extent may be said to have implemented the curriculum; and perhaps It Is along that 
dimension that the effects of involvement in decision-making would have been demon- 
strated* 

Since It seems reasonable to conclude that curriculum implementation Is a 
function of a number of interrelated variables, the need for additional study In 
this area based on some conceptual framework and utilizing a syntactical structure 
based on experimental evidence seems warranted* This is necessary for two reasons, 
at least* The evolution of descriptive curriculum theory is not possible without 
taking this approach to a study of the variables involved* And, rational curriculum 
engineering In schools is dependent upon replacing the prescriptions of the past with 
valid descriptive theory* 
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